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Abstract. We study rational streams (over a field) from a coalgebraic perspective. Ex- 
ploiting the finality of the set of streams, we present an elementary and uniform proof of 
the equivalence of four notions of representability of rational streams: by finite dimensional 
linear systems; by finite stream circuits; by finite weighted stream automata; and by finite 
dimensional subsystems of the set of streams. 



1. Introduction 

A stream over a given set A is an infinite sequence of elements of A. Streams are abound 
in both mathematics and computer science. Think of hmits in mathematics, typicahy defined 
in terms of converging sequences, and of Taylor series of analytical functions. In computer 
science, streams occur in various fields such as data flow, infinite data types, semantics, formal 
power series, and functional programming. 

In this paper, we study rational streams (over a field). They are well-known in mathe- 
matics, notably system theory, but have not received much attention in computer science. In 
contrast, a basic ingredient in any introductory course in the theory of computation is the 
notion of rational language (also called regular language). Rational languages are a proto- 
typical example of a finitely presentable data type: a language is rational if and only if it is 
recognisable by a finite automaton. 

As we shall see, rational streams are similarly finitely representable, in various ways. 
More specifically, a stream is rational iff it satisfies one of the following equivalent conditions: 

(a) it is representable by a finite dimensional linear system; 

(b) it is computable by a finite stream circuit; 

(c) it is representable by a finite weighted stream automaton. 

We shall explain the details of all of this as we will go along, but for now it is worthwhile 
pointing out that condition (c) is similar, in the case of languages, to being recognisable by a 
finite automaton. Condition (b) is particularly nice and relevant for computer scientists, since 
it provides a very elementary characterisation of rational streams in terms of finite memory 
(registers) and feedback. 
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Streams are for the theory of coalgebra, one could say, what the natural numbers are for 
algebra: a canonical example illustrating some of the essential notions of the theory. The set of 
natural numbers is an initial algebra (and satisfies a principle of induction). Dually, the set of 
streams is a final coalgebra (and satisfies a principle of coinduction) . In the present paper, the 
proofs of the equivalence of the above three conditions will in essence be based on the finality 
of the set of streams. Finality moreover provides yet another equivalent characterisation of 
rationality. A stream is rational if and only if 

(d) it generates a finite dimensional subsystem of the set of all streams. 
As we shall see, this criterion is particularly useful for proving that a stream is not rational. 

Most of the above and of the contents of this paper is already known, but often at 
different places in the literature and typically formulated in different languages, as it were. 
The equivalence of rationality and condition (a) above is taken as a definition in the theory 
of formal power series |BR88| . The equivalence of rationality and condition (b) is proved 
in system theory and in signal processing, where stream circuits are known under various 
names (such as signal flow graphs) [KaiSOl [Lah98j : see also our earlier paper |Rut07| . The 
equivalence between (a) and (c) is known in automata theory. Condition (d) occurs in some 
of our own work [RutOSbj : its use here to disprove rationality of a stream seems to be new. 

All in all, our main goal has been to present rational streams and all of their characteri- 
sations in one place and in elementary and uniform terms. Moreover, this paper is intended 
as a form of publicity for rational streams to the computer science community. They provide 
a basic and simple model of finite memory and feedback and deserve, therewith, a place in 
the heart of the foundations of the theory of computing. Finally, our treatment of rational 
streams serves as a good illustration of the relevance of the combined use of both algebraic 
and coalgebraic methods in computer science. 

2. Rational streams 
We define the set of streams over a given set A by 

A^ = {a\a:{0,l,2,...}^A} 

We will denote elements a G A'^ by a = (o"(0), o"(l), o"(2), . . .). We define the stream derivative 
of a stream a by 

a' = (a(l),a(2),a(3),...) 
and we call cr(0) the initial value of a. For a ^ A and a € A'^ we use the following notation: 

a:a = (a,a(0),a(l),a(2),...) 

For instance, a = cr(0) : a', for any a £ A^ . (In computer science, the operations of initial 
value and derivative are known as head and tail^ 

If the set A carries some algebraic structure then typically this induces some structure 
on the set A^ as well. In particular, if the set A is a (semi-)ring 

A = (A+, -,0, 1) 

(see the Appendix for the full definition) then the set A'^ of streams over A can be equipped 
with operations and constants that allow the formulation of an elementary but useful calculus. 
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So let A be a (seini-)ring. Examples are the set of real numbers (which is also a field) 
and the set of linear transformations on a vector space. We define the following operators on 
the set A^ of streams over A, for all c a A, a,T (z A^, n > 0: 

[c] = (c, 0, 0, 0, . . .) (often simply denoted again by c) 

X = (0,1,0,0,0,...) 

{a + T){n) = a{n) + T{n) [sum] 

n 

{a X T){n) = ^^o"(i) • T{n — i) [convolution product] 

1=0 
(where • denotes multiplication in the ring A). For the above definitions, it is already 
sufficient if ^ is a semz-ring. If A is moreover a ring then it comes equipped with an additive 
inverse, which extends to streams, for a G A^ , as follows: 

-a = (-a(0), -a(l), -a(2), ...) 

(here the minus symbols on the right are from the ring A). If the initial value (t(0) of a stream 
a has a multiplicative inverse (t(0)~^ in A then a has a (unique) multiplicative inverse a~^ 
inA^: 

cr-i X cr = [1] 

As usual, we shall often write l/o" for a^^. If • and hence x is commutative, then we also 
write a/r for a x t~^ . 

In general, the nth element o"(n) of a stream a is trivially given by 

a(n) = a(")(0) 

where the superscript (n) denotes the nth stream derivative. In [RutOSbj . various rules for 
the computation of stream derivatives are given. For the examples used in the present paper, 
all we shall be needing is the very simple rule presented in Corollary 12.51 below. 

The stream operators introduced above are well behaved in that they inherit the proper- 
ties of the operators of the underlying (semi-)ring. Notably sum and product are associative; 
sum is commutative but product x is only commutative if • is; [0] is the additive identity, 
[1] is the multiplicative identity. Another property we shall be using is the following. For all 
a(^A^, 

X xa= ax X (2.1) 

Note that this property also holds for (semi-)rings A in which multiplication is not commu- 
tative. 

Since X^ = (0, 0, 1,0, 0, 0, . . .), X^ = (0,0,0,1,0,0,0,...) and so on, the following infinite 
sum is well defined, for all a G A^: 

a = a{0) + ((t(1) xX) + (a(2) x X^) + ■ ■ ■ 

(Note that we write a{i) for [(T(i)]; similarly below.) It shows that a can be viewed as a 
formal power series in the indeterminate X (which here in fact is a constant stream). What 
distinguishes our approach from the classical theory of formal power series is a systematic 
use of the operation of stream derivative and the universal property of finality it induces (cf. 
Section S]). This leads to a somewhat non-standard algebraic calculus, which we call stream 
calculus. 
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The following identity shows how one can compute a stream from its initial value and its 
derivative. Since this amounts to a form of (stream) integration it is called the fundamental 
theorem of stream calculus |Rut05b] . 

Theorem 2.1 (Fundamental theorem). Let A be a (semi-)ring. For all a € A'^, 

a = cj(0) + {X X a') 
Proof. Immediate from the fact that X x a' = (0, o"(l), cr(2), a(3), . . .). □ 

For future reference, we list the following identities on initial values, which are immediate 
from the definition of the operations on streams. 

Proposition 2.2 (Initial values). For all a G A^, 

(a + r)(0) = (T(0)+r(0) 
(cjxr)(0) = cj(0)-r(0) 
a-HO) = a(0)-i 
where in the last identity o"(0) is assumed to have a multiplicative inverse in A. □ 

Next we introduce the notion of rational stream. 

Definition 2.3 (Rational streams). We call a stream vr polynomial if it is of the form 

vr = Co + (ci X X) + (c2 X X^) + • • • + (c^ x X^) 

= (co, Ci, C2, ..., Cfc, 0, 0, 0, ...) 

A stream p is rational if it is the quotient 

p = a/r = a X t~^ 

of two polynomial streams a and r for which r(0)~^ exists. We denote the set of all rational 
streams over A by 

Rat{A^) = {a e A^ \ais rational} 

D 

Remark 2.4. In the literature, one also encounters the notion of rational stream defined as 
being ultimately periodic. In the present setting, these streams can be simply characterized 
as having only finitely many distinct derivatives. As we shall see in Section [5l it follows from 
this basic observation that ultimately periodic streams are a special case of rational streams 
in our sense. □ 

Theorem 12 . 1 1 (together with Proposition l2.2p gives an easy calculation rule for the computation 
of stream derivatives. First note that for all a G A^ , 

{X xa)' = a (2.2) 

Furthermore we have, for any a G A^ ., that X x a' = cr — (t(0), by Theorem 12. 1^ and 
{X X a')' = a' , by (12.20 . As a consequence, we have the following. 

Corollary 2.5. For all a e A'^ , 

a'= ia-a{0)y 

D 



RATIONAL STREAMS COALGEBRAICALLY 



This trivial identity makes the computation of stream derivatives often surprisingly simple. 
Example 2.6. Let 



1 
a 



l-{cxX) 
with c G A. We compute 

a' = {a-a{0)y [CoroUaryES] 

1 



1 - (c X X) 

ex X 
1 - (c X X) 



1 [Proposition [O 



X X j^ — — ) [identity (HI 

1 - (c X X)y 

[identity f^ ] 



and, more generally, 



l-{cxX) 



aW 



1 - (c X X) 

Using the fact that (T{n) = a^"'){0), this yields the following well-known expression for this 
prototypical example of a rational stream: 

(1, c, c^, ...) (2.3) 



Similarly for 
one computes 



1 - (c X X) 

1 



{1-xy 



t' 



ir-rm' 



and again more generally, 
leading to 





/ 1 


-1 




[{1-xr 




f2X-X^' 


V 




l(l-^)^ 


j 


= 


(^^i^ 


X y 




2-X 






(1-X)2 




(n) _ 


(n + l)-(nxX) 



(1-X)2 



(1-X)2 

= (1,2,3,...) 



D 
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3. Streams and vector spaces 

Let F be a vector space (over a field k). The set 

y-= {a\a:{0,l,2,...}^V} 

of streams over V is itself a vector space, with addition and scalar multiplication given, for 
n > and c £ k, hy 

{a + T)(n) = a{n) + T{n) (c • a){n) = c ■ (7{n) 

where on the right we use vector addition and scalar multiplication in the vector space V. 

For future reference, we denote the operations of initial value and derivative by i : y" — > V 
and d-.V^ ^ V^: for ah a G V^, 

i{a) = o-(O) d{a) = a' 

Proposition 3.1. The operations of initial value i : V^ -^ V and derivative d : V^ -^ V^ 
are linear. 

Proof. Immediate from 

{x ■ a + y ■ t){0) = X ■ (t(0) + y ■ r(0) {x ■ a + y ■ t)' = x ■ a' + y ■ t' 
for all x,y £ k and o", r € V^ . □ 

3.1. Streams of linear transformations. Next we define streams of linear transformations. 
To this end, we first note that the set 

L{V, V) = {F : V ^ V \ F is a linear transformation } 

(which we shall usually denote by L) is a ring 

{L,+L, •l,Ol, U) 

Addition F +l G, multiplication F -l G, and negation —lF are defined, for all F,G £ L and 
u G F, by 

{F+lG){v) = F{v) + G{v) 

{F-lG){v) = FoG{v) 

{-lF){v) = -F{v) 

The neutral elements Ol : V ^ V and 1l : V ^ V for sum and multiplication are given, for 
all ?; G y, by OL(f) = Oy (the zero vector in V) and 1l(w) = v. 

The set L of linear transformations on a vector space V being a ring, we have, by the 
definitions of Section [21 a calculus of streams of linear transformations. Streams (j) £ L^ are 
infinite sequences (p = i4'{0) ? 4'i^) : 4'i'^) y ■ ■) of linear transformations (f){i) : V ^ V. The 
operations of sum and (convolution) product are given, for (pjip € L'^ , by 

{4) + i)){n) = (j){n) +L'4'in) 



{(j)XiP){n) = ^(j){i)-Lip{n-i) 

n 



i=0 
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As before we also have, for every F (^ L, a constant stream 

[F] = {F, Ol, Ol, Ol, ■ ■ ■) 
In particular we also have 

[U] = (1l, Ol, Ol, Ol, ...) 
which we shall often simply denote by 1. The constant stream X now looks like 

X = {Ol, 1l,0l,0l,0l, ...) 

Every stream cp € L'^ has an additive inverse —(j) given, as before, by 

-,^. = (-0(0), -</.(!), -0(2), ...) 

A stream cj) E L^ has a (unique) multiplicative inverse (p^^ in L'^: 

0-1x0 = 1 (= [U] ) 

whenever the linear transformation 0(0) : V ^ V has a multiplicative inverse in the ring L, 
that is, whenever 0(0) is invertible. 

Example 3.2. For any linear transformation F € L, we define the stream F € L^ by 

.r, 1 



1 - {[F] X X) 

As before, it is a prototypical example of a rational stream. Note that 

1-([F] xX) = {Il,-F,0l,0l,0l,...) 

indeed is invertible in L'^ as 1l is trivially invertible in L. As an instance of identity (j2.3p in 
Example 12.61 we have 

where now F"+i = F o F", ah n > 0. □ 

So far we have looked at the set L = L(V, V) of streams of linear transformations from 
a vector spave V to itself. It will also be convenient to consider (streams of) linear transfor- 
mations between two different vector spaces V and W: 

L{V, W) = {F : V ^> W \ F is a linear transformation } 

Note that L(V, W) is not a (semi-)ring — we cannot define multiplication to be composition 
as we did with L{V, V) — and as a consequence the set L{V, W)'^ of streams over L{V, W) 
does not have as much structure as the set L{V,V)^. It will be convenient, however, to use 
the following generalised version of the operation of convolution product. For vector spaces 
U,V,W and for all G L{U,V)'^ and ^ € L{V,W)'^ we define ^ x G L{U,Wy, for all 
n > 0, hy 

n 

(V^x0)(n)= ^V'(i)o0(n-i) (3.2) 

1=0 

One can also apply streams of linear transformations to streams of vectors, as follows. For 
all G L{V, Wy and a ^V^ we define x a G W^ , for all n > 0, by 

n 

(0xa)(n)= J]0(i)((T(n-i)) (3.3) 

i=0 
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For a linear transformation H : V ^ W, we put again 

[H] = (H, Ol, Ol, Ol, . . .) 

(where now 0^ is the everywhere zero transformation from V to W). As a special case of 
(|3.3p we have 

[H]xa = iHiaiO)),H{a{l)),Hiai2)),...) 

Note that the set of streams L{V,V)'^ has also its own operation of convolution product, 
which interacts nicely with the product defined in (j3.3p . For instance, for (/), ■0 G L(V,V)^ 
and a € V^ , 

{(f) >i il)) X a = (p yi {iIj X a) (3.4) 

3.2. Streams of matrices. Since linear transformations between finite dimensional vector 
spaces (over a field k) correspond to matrices (with entries in /c), streams of linear trans- 
formations correspond to streams of matrices. Here we show how rational streams of linear 
transformations correspond to matrices with rational streams (over k) as entries. 

First some conventions. For any set A and n > 1, we denote the elements v € A"' by 
V = [vi, . . . ,Vn)- It will sometimes be convenient to switch between streams of tuples and 
tuples of streams. We define the transpose as follows: 

(_)T , (^A-r - (^")" (a^)i(j) = Hj))i (3.5) 

This function is an isomorphism and has an inverse which we denote again by 

{-f : (A"^)" ^ (A")'^ 

Now let k he a field. A linear transformation F : k"' ^> A;™ between finite dimensional 
vector spaces corresponds to an m x n matrix Mp with values Fij in k: 

I -^11 -^12 ■ • • Fin \ 



^ -^21 F22 ■ • • F2n 

F -.k"" ^k"^ Mf = 

\ ^ml ^m2 ' ' ' ^mn J 

Here and in what follows, the matrix is with respect to the standard basis 

(1,0,. ..,0), ..., (0,...,0,1) 

of A:" and /c™. Any stream = (0(0), 0(1), 0(2), . . .) of linear transformations 0(«) : A:" — > k™" 
corresponds to a stream of matrices 

(M^(0), M^(i), M^(2), . . .) = M^(o) + (M^(i) X X) + (M^(2) x X^) + • • • 

If we consider M^u\ x X* as an tti x n matrix obtained from M^u\ by multiplying each of its 
entries by X*, then the infinite sum on the right can itself be viewed as an ?Ti x n matrix M^ 
with entries in k^: 

{M^),, = (M^(o)),, + m^(i))ij xX) + {{M^(2)h X X2) + . . . (3.6) 
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The correspondence between and M^p is given by the following commutative diagram: 

</,x(-) 



(A;")'^ —-4 {k'^Y {ct> X af = M^ x a^ (3.7) 



(-)' 






Here (/> x a is as defined in ()3.3p and M^ x a denotes matrix to vector multiplication. 

Consider L = L(fc"',fc") and recall that [1l] = (1l, 0/,, 0^, Ol, . . .). Let / be the nx n 
identity matrix over k. We have: 

M[i,] = / (3.8) 

Furthermore addition and convolution product of streams of linear transformations, on the 
one hand, and matrix addition and multiplication, on the other, are related as follows: 

M^y,^ = M^ X M^ (3.9) 

As a consequence, we have the following proposition. 

Proposition 3.3. Let p G L{k"', k"'Y be a stream of linear transformations p{i) : k"' -^ fc". 
If p is rational then Mp defined in (|3.6p has entries in Rat{k^). 

Proof: Consider two polynomial streams (p,ip £ L{k'^,k'^Y. The entries of the matrices M^ 
and M^ are polynomial streams in k^. 1( ip moreover has an inverse tp~^ then (j3.8p and ()3.9p 
imply M^-i = {M^)~^, which has values in Rat{k'^). It follows that M^y^^-i = M^ x (M^)"^ 
has values in Rat{k^). □ 

Example 3.4. Let A; = IR and let F, G : IR — > IR be linear transformations defined by 

^-=(J J) ^^=(? ~2 

We compute the matrices of the rational streams F = ( 1 — (i^ x X) )~^ and G = ( 1 — (G x 

^<5 = (^MGxX)) ^ = ( _;, l-2xj =(r3xF"l X l) 
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4. Linear representations 



We introduce linear systems and show how they can be used as representations for 
streams. In particular, we shall show how finite dimensional linear systems represent ra- 
tional streams. 

Let O be a vector space the elements of which we think of as outputs. A linear system 
with output in O is a pair {V, {H,F)) consisting of a vector space V called the state space 
together with a linear transformation F : V ^ V called the transition function (or dynamics) 
and a linear transformation H : V ^> O called the output function. 

A linear system with output in O — or linear 0-system for short — is in other words a 
coalgebra of the functor 

O X (-) : Vect -^ Vect 

on the category Vect of vector spaces and linear transformations. As a consequence, there 
is the following (standard) notion of homomorphism. A homomorphism of linear systems 
iy, {Hy,Fy)) and {W., {Hw, Fw)) is a linear transformation f -.V ^>W such that Hv/ o / = 
Hv and Fw o f = f o Fy: 



V >W 



{Hv.Fv) 



{H^,Fw) 



O X V UO X W 

We saw (in Section [3|) that if O is a vector space then O'^ is also a vector space. Since the 
operations of initial value i : O'^ — >■ O and derivative d : O^ — > O^ are linear transformations 
(Proposition 13. ip . {O^, {d,i)) is a linear 0-system. It is final among all linear O-systems. 

Proposition 4.1 (Finality). From every linear 0-system {V,{H,F)) there exists precisely 
one homomorphism to {O^ , {i,d)): 



V- - - - ^O^ 



{H,F) 



{t,d) 



OxV U O xO"^ 

Proof. There exists precisely one function / : y — > O^ making the diagram above commute. 
It is given by 

f{v)= iH{v),HoF{v),HoF\v),...) 
for all V (zV and it is linear because both H and F are. □ 

Definition 4.2 (Linear representation). In the situation above, we call the stream f{v) the 
final behaviour of v. We call the linear O-system {V, {H,F)) with designated point v a V a 
linear representation for the stream a € O'^ if f{v) = a. □ 

Next we look at the special case where both O and V are finite dimensional vector spaces 
over k. So let n,m>l, let 

= k"', F = A:" 
and consider a linear A:'"-system {k"',{H,F)) with dynamics F : k'^ ^ k^ and output H : 
fc" -^ k"^. The final behaviour f : k"" ^ (fe™)*^ will map any state u G A;" to a stream of 
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vectors in k™'. We claim that the transpose of the latter consists of a vector of m rational 
streams in k^ . 

Theorem 4.3. Let n,m>l and let (A:", {H,F)) be a finite dimensional /^'"-system. Let 

be the final behaviour homomorphism. Then for all v (z k'^, 

f{vf G Ratik'^r 

Proof. First we observe that for every v a V, we can express f{v) in terms of convolution 
products as follows: 

f{v) = iH{v),HoF{v),HoF\v),...) 

= (F,0,0,0,...) X (1,F,F2,...) X (v, 0,0,0,...) [using dSSD and dUD] 

= (//,0,0,0,...) xFx (v, 0,0,0,...) [using (EH)] 

= [H]x F X [v] 

By ()3.7p . the following diagram commutes: 



(/c")"^ ^""^ ^ (A:")" ^'^'"'^ \ (fc"*)^ (4.1) 



(-) 



(-)^ 



(-) 



T 



or, equivalently, 

([i/] X F X {-)Y = M[H] xMpx {-f 
It follows that the final behaviour / satisfies 

f{vf = {[H] xFx [v]f = M[^] xMpX [vf (4.2) 

The matrix Mifji has entries in (k and thus in) Rat{k^). Since F = {1 — {F x X))^^ is a 
rational stream, the matrix Mp has values in Rat{k^), by Proposition 13.31 As a consequence, 
/(f)^ is obtained from [v]'^ by multiplication with an m x n matrix with values in Rat{k'^). 
This proves the theorem. □ 

Since finite dimensional linear systems are finitary objects (being completely determined by 
two finite matrices), the relevance of Theorem 14.31 lies in the fact that it shows that such 
finitary systems represent (vectors of) rational streams. In Section [H we will see that any 
rational stream can be represented in this manner. But first we look at a few examples 
illustrating the present theorem. 

Example 4.4. Let A; = IR and consider the linear system (IR^, {H^ F)) with output H : IR^ — > 
IR and dynamics F : IR ^ IR given by 

■ 1 1 



H=il 1) F-, Q ^ 
The matrix Mp corresponding to F has been computed in Example [37 

X 



M- = ( i-^x i-x 
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The final behaviour f^n.F) '■ ^ ~^ ^'^ of this system is given, for any (a, 6) G IR , by 

b 



f^H,F)ia,b) = (1 1 ) X ^ 1/ 1-^ 



1-X 

(omitting square brackets around a and b as usual). Repeating the example with a different 
output function H and the same dynamics F: 



5=(12) F=[ll) 



leads to the following final behaviour: 

„ , , . /I 2-x \ f 0, \ a + 2b-bX 

f{H,F)ia,b) = {j^ frf ) X (^ ^ J = ^_^ 

D 

Because linear O-systems are coalgebras, the general definition of coalgebraic equivalence 
applies. In conclusion of this section, we spell out this definition together with the observation 
that the corresponding minimization of a system is given by (the image under) the final 
behaviour mapping. 

Equivalence of linear O-systems is defined as follows. A relation R C V x W is called 
an O -bisimulation between O-systems {V, {Hy,Fy)) and iyV, {Hw,F\y)) if for all u S V^ and 
w eW: 



/„ ,„\ c R ^ / ^v{v)= Hw{w) and 



We say that v and w are O- equivalent and write v ~o w if there exists an 0-bisimulation 
R with {v,w) € R. The final behaviour / : y — > O^ of an O-system {V, {Hv,Fv)) identifies 
precisely all O-equivalent states: vi ~o ^2 ifi^ /(^i) = f{v2), for all ui,f2 € V. (For the 
elementary proof, see |Rut05bj .) As a consequence, the minimization of an O-system with 
respect to O-equivalence is given by the image of V under /, which is a subsystem f{V) C O^ 
because / is a homomorphism. It follows that the greatest O-equivalence on V is given by 
the kernel ker{f). 

5. Constructing linear representations 

Let A; be a field. We show how to construct finite-dimensional linear representations for 
(vectors of) rational streams in k^ . 

For a stream a € O'^ we consider the smallest subspace of O^ that contains a and is closed 
under the operation of stream derivative, that is, the linear transformation d : O^ — > O^ . 
This (so-called d-cyclic) vector space Za- is the subspace of O^ that is spanned by the set of 
vectors given by 

{aW,a«,a(2),...} (5.1) 

with a^^' = a and 0"'"+^' = d{a^"'') = (cr^"))'. We can turn Zo- into a linear system by taking 
as output function and transition function the restrictions of i : O^ — > O and d : O^ — > O^ 
to Zq-. The set inclusion 

f:Z^CO^ 
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is then a homomorphism of linear O-systems. By finality of {O^ , {hd)), this homomorphism 
is unique. It follows that (Zo-, {i,d)) with initial state a is a minimal representation of a. 

In general, the dimension of Z^^ will be infinite. Of special interest are those a € O'^ for 
which there exists an n > 1 such that all of a = a^^^ through a^"'~^^ are linearly independent 
and 



a 



in) 



n 

E ^^ X <^^"^ 

j=0 



for some coefficients cq, . . . , Cn-i in the base field A; of O and O^ . Then Z^ is a vector space 
of dimension n. The linear transformation G : Z„ ^ Z„ induced by d : O^ -^ O^ is given, 



with respect to the (ordered) basis a 



(0) 



, o"'^" ^' , by the n x n matrix 



Mg 



/ 
1 
1 



Co \ 

ci 

C2 



V • • • 1 c„_i / 

(This matrix is in fact (a variation of) the companion matrix of the so-called d-order poly- 
nomial of a; cf. |BM77l Thm.l5, p. 339].) The linear transformation H : Zu ^ O induced by 
i : O'^ — s- O is given, again with respect to the basis a^^' , . . . ,a^^^^\ by the matrix (of size 
dim{0) X n) 

MH={a(-^\0) cj«(0) cj(2)(0) ••• cj("-i)(0) ) 
Thus we have obtained a linear O-system (Zu, {H, G)) of dimension n. As before, the inclusion 
f '■ Zfj C. O"^ is a homomorphism. Thus /(r) = r, for all t ^ Z^j and (Zo-, {H, G)) with a as 
initial state is a minimal representation of a. 



Example 5.1. Let O = IR and consider the stream a = 1/(1 — X)"^ € O^ . Computing the 
successive stream derivatives of o" = a^^> , using Corollary 12.51 gives 

2-X ,o^ 3-2X _^(0)^(2xa«) 



a 



(1) 



a 



(2) 



Mh 



1 2 



Mg 



(1-X)2 (1-^)2 

Thus 0"^'^) and a^"^' form a basis for Zfj. Because a^^'{Q) = 1 and a^^'{0) = 2, we have 

-1 

1 2 

Now a is represented by (Zg-, {H,G)), with o" as the initial state. Clearly, IR'^ = Za-. Note 
that this isomorphism can also be obtained by computing the final behaviour / : IR — > IR"^ 
of the O-system (IR^, {H,G)), using Theorem 14.31 This gives, for all (ri,r2) G IR^, 

f{ri,r2) = Mh X M^x (ri,r2) 

1 /i-^2X -x\ ^ fn 



1 



' {l-Xy \ X 1 J \r2 

(Recall the computation of M^ from Example 13.41 ) As expected, we have /(1,0) = a and 
/(0,l) = a(i). □ 
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Example 5.2. Let O = IR^ and consider the pair (r, a) G (IR'^)^ ^ (IR^)"^, with r 
1/(1 — 2X) and o" = 1/(1 — X)'^. Computing (pairs of) stream derivatives 

2 2-X 



(r,cT)(2) 
(r,cT)(3) 



1-2X' (1-X)2 
22 3-2X 



1-2X' (1-X)2 
23 4 - 3X 



1-2X' (1-X)2 
= 2 X (t,cj)W - 5 X (r,(j)« + 4 X (r,(j)(2) 
we see that Z(^^^„-^ has dimension 3 with H : ^(t-,o-) ^ K-^ and G : ^(r,o-) ~^ ^{r,a) given by 

Mj^ = ( J 2 3 "l Mg = ( 1 -5 




D 



Theorem 5.3. Let A: be a field and let O = k"^. A vector of streams a G {k'^)'^ is repre- 
sentable by a linear A;'^-system of finite dimension iff cr € {Rat{k'^))'^ . 

Proof. From left to right, this is Theorem 14.31 For the converse, it is sufficient to observe that 
the examples above generalise to arbitrary vectors of rational streams. This is immediate 
from the fact that for a rational stream a = p/r, the dimension of Zq- in the construction 
above is bounded by the maximum of the degrees of p and r. □ 

For single streams, the results of this section can be summarized as follows. 

Theorem 5.4. Let /c be a field. For a stream a € k'^, the following are equivalent: 

(1) The stream a is rational: a = p/r for polynomial streams p and r (with r(0) ^ 0). 

(2) The stream a is representable by a linear system of finite dimension. 

(3) The subsystem Zu C (^k^, {i,d)) generated by a has finite dimension. 

D 

In conclusion of this section, we show that (3) above can be conveniently used to prove that 
a stream is not rational. 

Corollary 5.5. In order to prove that a stream a £ k'^ is not rational, it suffices to show 
that 

{aW,a«,a(2), ...} Cfc- 

contains infinitely many linearly independent vectors. □ 

Example 5.6. Consider a € IR"^ given by 

a = (1,1,0,1,0,0,1,0,0,0,1,0,0,0,0,...) 

= 1+ x+ X^+ X^+ X^^ + X^^ + ■■■ 



y^j^k{k+i) 



l)/2 
fc=0 
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The set of stream derivatives of a contains the following infinite subset of linearly independent 
streams: 

(1,...) 

(0, 1, ...) 

(0, 0, 1, ...) 

(0, 0, 0, 1, ...) 

Thus (T is not rational. □ 

6. Stream circuits 

We saw that rational streams can be represented by finite dimensional linear systems. 
Such systems are finitary in that they are determined by (two) finite dimensional matrices 
with values in k. In this section, we show that such systems — and as a consequence rational 
streams — are, equivalently, computed by so-called stream circuits with finite memory. 

Stream circuits (with values in a field k) are data flow networks that act on streams of 
inputs and produce streams of outputs. They are built out of four types of basic gates by 
means of composition, which amounts simply to connecting (single) output ends to (single) 
input ends. We introduce these basic gates below, first describing their single-step behaviour 
in terms of input and output values (in A;). Next we shall describe their behaviour in terms 
of input and output streams (in k''^). 

(i) For a fixed r G /c, an r-multiplier 

X I > r ■ X 

inputs a value x G k at its input end and outputs that value multiplied with r at its 
output end. 
(ii) A register 

y\ \x] > 

is a one-element buffer (or memory cell) containing as initial value an element x € fc. 
Its stepwise computation consists of the (simultaneous) output of the present value 
X in the buffer together with the input of an element y £ k, which becomes the new 
contents of the buffer: 

¥ X 



(iii) An adder 



y 



H >x+y 



yy^ 

takes two input values at its input ends and outputs their sum at its output end. Here 
we show a 2-to-l adder but more generally we will also use n-to-1 adders, for n > 2. 
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(iv) Lastly a copier 

XI C 

^~~-^ X 
inputs a value at its input end and outputs multiple copies of it at its output ends. 
Here we show a l-to-2 copier but more generally we will also use 1-to-n copiers, for 
n > 2. 

Sometimes it will be convenient to combine multipliers with adders (and similarly copiers). 
For instance, 

H > (ri • x)+ (r2 • y) 

multiplies its inputs x and y with the values ri and r2 and outputs the sum of the results. 

The presence of memory (in the form of registers) makes that the behaviour of stream 
circuits cannot be described simply in terms of functions of single input and output values 
in k. (This is reflected in our explanations above by the fact that we needed two pictures to 
illustrate the behaviour of a register.) Rather we shall describe the behaviour of our circuits 
in terms of streams of inputs and outputs. As it turns out, all we need are the basic operations 
of stream calculus: 

(i) An r-multiplier converts a stream of inputs a € fc"^ 

a I )■ [r] X a 

into a stream of outputs [r]xo" by elementwise multiplying the input values with r: 
[r]xa = (r • C7(0), r ■ a{l), r ■ a{2), . . . ) 
(ii) A register with initial value x ^ k takes a stream of inputs a 

a\ — \x] >[x\+{Xy.a) (6.1) 

and outputs it with one step delay, after having output the initial value x first: 

[x]+(Xxct)= (x, C7(0), a(l), ...) 

(iii) An adder takes two input streams a and r 

a I — 

T 1 

and outputs the stream consisting of their elementwise addition: 
a+T = (a(0) + r(0), a{l) + r(l), a{2) + r(2), . . .) 
(iv) The copier simply copies input streams into output streams: 

CTI C 
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Combinations of multipliers and adders (and similarly copiers) have the expected stream 
behaviour: 



CTf-^'*! 



+ 



-^([ri] X cr)+([r2] X r) 



Now that we have seen the basic gates and their behaviour, let us look at composite 
stream circuits and see how their behaviour can be computed from that of the gates from 
which they are made. Consider the following circuit, built out of two registers, two copiers, 
three adders, and six multipliers (two of which are combined with the adder at the bottom): 




M 



In the picture above, we use o to denote the composition of an output end with an input end. 
The circuit as a whole has no external input ends and one external output end. The heart of 
the circuit consists of two registers with initial values ri and r2- The outputs of the registers 
are copied and: 

(a) fed back to the input ends of the registers, via multipliers whose values can be ex- 
pressed by the following 2x2 matrix: 

-1 

1 2 

This leads to new values of the registers given by 

-1 W n \ ^ / -r2 

1 2 )\r2 ) \n+2r2 

(b) At the same time, the outputs of the registers are fed forward into an adder combined 
with multipliers whose values are given by the following matrix: 

N ={l 2 ) 

This leads to a (first) output value given by 



1 2 



ri 
r2 



ri + 2r2 
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We call this a circuit in canonical form. More generally, we have the following definition. 

Definition 6.1. We say that a stream circuit is in canonical form if it has no input ends and 
one output end; consists of n > 1 registers with feedback lines given by an n x n matrix; and 
has feedforward lines given by an 1 x n matrix leading via an n-to-1 adder to a single output 
end. □ 

In the description of the example circuit above, (a) and (b) together describe one single atomic 
computation step of the circuit. Next we describe the stream behaviour of our example 
canonical circuit. As we shall see, the output end of a canonical stream circuit produces 
precisely one (rational) stream. In order to compute this output stream, we first give names 
(<T and r) to the streams that will occur at the output ends of the two registers. Then we 
apply the stream equations for each of the basic gates in the circuit, leading to: 



01 



H 1 



a 



a < C > cr 



ah 




+ 



Ti C 



H r 



-)■ r 



Applying the register law (j6.ip to our two registers then leads to the following two equations 
(writing r for [r] as usual): 

c = ri + {X X — r) 

r = r2 + {X X {a + 2t)) 



or, equivalently, in matrix notation: 

a \ ( r\ 



r2 J \ 1 2 



whence 



1 X 

-X 1-2X J \ T 
This leads to the following values for a and r: 



1 X 

-X 1 - 2X 



-1 



ri 

^2 



n 

r2 
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(recall that this inverse matrix was computed in Example I3.4p . As a consequence the output 
stream of the circuit is given by 

.+2. = (1 2)x (_^ i:\t)"'< (:;) c^-^) 

We saw that the above circuit is fully determined by the two matrices M and N containing 
the values of the (feedback and feedforward) multipliers. As such, the circuit corresponds 
precisely to a linear system (/c^, {H, G)) with G : k"^ ^ k"^ and H : k"^ —> k given by 

G(ri,r2)= Af X (^ ^1 ) /7(ri,r2) = iV x (^ ^^ 

A state of this linear system corresponds to the contents of the two registers of the circuit; 
G{ri,r2) corresponds to the feedback multiplication with the matrix M; and the output given 
by H{ri,r2) corresponds to the feed-forward multiplication with the matrix N. Note that 
the stream behaviour of our circuit as described above corresponds precisely with the (final) 
behaviour of the corresponding linear systems, as given by (the proof of) Theorem 14.31 in 
Sectional This follows from the fact that identity (j6.2p equals 

= M|„, X Mg X (^ j:' 

with H and G as defined above. 

Summarizing, we have presented an example of a canonical stream circuit and shown that 
how to compute the (rational) stream that it produces at its output end. Then we observed 
that such a canonical stream circuit corresponds precisely to a finite dimensional linear system 
via its two matrices of feedback and feedforward multipliers. Moreover, the stream behaviour 
of the circuit coincides with that of the linear system. 

In conclusion of this section, we note that one can construct, conversely, from any finite 
dimensional linear system {V, {H,G)) a corresponding canonical stream circuit with exactly 
the same stream behaviour: the dimension of V determines the number of registers; the 
matrix corresponding to G determines the values of the feedback multipliers; and the matrix 
corresponding to H determines the values of the feedforward lines. 

All in all, we have proved the following. 

Theorem 6.2. Let A; be a field. For a E k^ , the following are equivalent: 

(1) The stream a is representable by a linear system of finite dimension. 

(2) The stream a is computable by a finite stream circuit. 

n 



7. Weighted stream automata 

We saw that rational streams are "finite memory": they can be computed by stream 
circuits with finitely many registers. In this section, we show they are also "finite state": 
they can be computed by finite so-called weighted stream automata. 

A weighted stream automaton with values in a field k is a pair {Q,{o,t)) consisting of 
a set Q of states, together with an output function o : Q ^> k and a transition function 
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t : Q —> {Q ^ k). The output function o assigns to each state q £ Q a value o{q) £ k cahed 
the output of q. The transition function t assigns to each state q £ Q a function t{q) : Q ^> k, 
which specifies for any state q' £ Q a value t{q){q') £ k. This number can be thought of 
as the weight with which the transition from q to q' occurs. (There are various possible 
interpretations of this notion of weight, such as the cost, multiplicity, duration etc. of the 
transition.) We will use the following notation: 

q-^q' = t{q){q') =r, q^ = o{q) = r 

Weighted stream automata represent streams in k"^ in the following manner. 

Definition 7.1. For a state q £ Q oi a weighted stream automaton (Q, {o,t)) we define a 
stream S{q), for all A; > 0, by 

S{q){k) = 

^ { /o X /i X • • • X Ik-i X / [ 3qo,...,qk : q = qo ^ qi ^ ■ ■ ■ -^^^^ Qk ^ } 
(Here x denotes multiplication in the field A;.) 



So the kth value of the stream S{q) is obtained by considering all transition paths of length k 
starting in the state q; multiplying for each such path the labels of all transitions; and adding 
up the resulting values for all paths. We say that the stream S{q) is represented by the state 

q- 

Example 7.2. Consider the following example of a weighted automaton: 

1 - r 

Computing the streams S{qi) and S{q2) according to Definition 17.11 above gives 

S{qi) = (1,2,3,...), S{q2) = (2,3,4,...) 

n 

We can represent all information contained in the definition of weighted stream automata by 
two matrices, in very much the same way as we could define stream circuits by two matrices 
as well. To this end, we define for a weighted stream automaton (Q,{o,t)), with states 
{gi, . . . , qn}, an output matrix L and a transition matrix K as follows: 

Li=o(qi), Kij = t(qi)(qj) 

Now we can compute the streams represented by the states of a weighted automaton directly 
in terms of these matrices. Illustrating this for the example automaton above, we have 

Applying Theorem 12.11 to the (vector of) streams 

a = S(qi), T = S{q2) 
we obtain 

cr\_( cj(0) 



r(0) ' + ^ ^ 
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Note that it follows from Definition 17.11 that 

a(0) 
t(0) 



L 



and 



As a consequence, we find 



cr' \ j^ la 
K X 



t' I \ T 



which leads to 



nMn-- -: i)^: 



cr \ ( \ -X \ ^ I \ 



T j \ X 1-2X J \2 

1 /1-2XX\ /I 



It follows that 



{i-xy \ -X 1 y \2 

S{qi) = a = — ^ , 5(^2) 



[i-xf ^^^' {i-xy 

showing that the streams represented by our weighted automaton are rational. All of the 
above generalises directly to arbitrary weighted automata and so we have proved one half of 
the following theorem. 

Theorem 7.3. A stream a ^ k^ \s rational iff it can be represented by a state g G Q of a 
finite weighted stream automata {Q, {o,t)) with values in k. 

Proof. The implication from right to left follows from the above. For the converse, consider 
a rational stream a a k^ . It follows from Theorem 15.41 that a is representable by a linear 
system of finite dimension (A;", {H,F)) with output in k. Without loss of generality we can 
assume that a is represented by the vector (1, 0, . . . , 0) G /c". We define Q = {qi, . . . , qn} by 

gi = (l,0,...,0), ... , g„ = (0,...,0,l) 

Next we define a weighted stream automaton (Q, {o,t)) by putting, for all I < i,j < n, 

o{q^) = H,, t{qi){qj) = F^^ = Fji 

It follows that a = S{qi), that is, a is represented by the state qi in {Q, {o,t)). □ 



8. Summary and discussion 
All in all, we have proved the following. 

Theorem 8.1. Let A; be a field. For a stream a G k'^ , the following are equivalent: 

(1) The stream a is rational: a = pjr for polynomial streams p and r (with r(0) 7^ 0). 

(2) The stream a is representable by a linear system of finite dimension. 

(3) The subsystem Zg- C {k^ ^ {hd)) generated by a has finite dimension. 

(4) The stream a is computable by a finite stream circuit. 

(5) The stream a is representable by a finite weighted stream automaton. 

D 
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We mention a few examples of the many interesting questions and directions that remain to 
be explored. Streams over a finite field enjoy many special properties. A special example 
is the family of bitstreams, which consist of O's and I's. The interplay between coalgebraic 
techniques and various algebraic structures on bitstreams, such as the Boolean and the 2-adic 
operators, deserves further study, which may also be relevant for the construction and analysis 
of digital circuits; see [RutOSal IHCR06] for some preliminary results. There is also much and 
interesting life beyond rationality. For instance, it would be worthwhile to try and apply 
coinductive techniques to the study of so-called automatic sequences, see for instance [AS03 . 
Another example is the combined use of linear systems theory and coalgebra in the world of 
hybrid systems, where discrete time and continuous time phenomena occur simultaneously. 
The relationship between rational streams and w-regular infinite words from formal language 
theory is yet another subject that deserves further study. 
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Appendix A. 

A semi-ring A = {A, +, •, 0, 1) is a set A with a commutative operation of addition c+d; 
a (generally non-commutative) operation of multiplication c • d with c- (d + e) = (c • d) + (c • e) 
and {d + e) ■ c = (d ■ c) + {e ■ c); and with neutral elements and 1 such that c + = c, 
1 • c = c • 1 = c and c • = • c = 0. If every c a A moreover has an additive inverse — c 
(with c+ (—c) = 0) then A is a ring. If moreover multiplication is commutative and every 
(non-zero) element c G A has a multiplicative inverse c~^ (with c • c^^ = 1) then j4 is a field. 
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